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Dementia causes massive cognitive, affec- 
tive, and social impairment as well as 
concomitant functional decline. Cogni- 
tive interventions, together with pharma- 
cological treatments, are acknowledged as 
important tools to delay mental weakening 
in dementing populations and to preserve 
the life quality of patients and their rel- 
atives (Prince et al., 2011; Woods et al., 
2012). Given the socioeconomic impact of 
dementia on the health system, it is crit- 
ical to assess cognitive intervention tech- 
niques in terms of cost-efficiency (Hurd 
et al., 2013). Nevertheless, most recent 
reports have neglected this issue, showing 
small, non-replicated, or even null results 
(Olazaran et al, 2010). Arguably, this is 
partly so because researchers are more spe- 
cialized in the study of impairments than in 
the design of intervention programs. Con- 
sequently, there is no agreement on how 
to define cognitive intervention or how to 
measure its success (Giordano et al., 2010; 
Fernandez-Prado et al, 2012). 

A problem implicitly evident in relevant 
meta-analyses is that methodological deci- 
sions affect the results' reliability and repli- 
cation (Bahar-Fuchs et al., 2013a). Usually, 
an intervention program involves partic- 
ipant inclusion criteria, pre-intervention 
measurements, training sessions, post- 
intervention measurements, and pre-post 
statistical analyses to unravel the possible 
intervention effects. However, systematic 
methodological considerations for cogni- 
tive intervention in dementia are scant 
(Wollen, 2010). To increase the efficiency 
of cognitive stimulation assessment, this 



paper sets forth guidelines for cognitive 
intervention design, control group for- 
mation, control condition manipulation, 
pre/post-intervention measurement, and 
statistical analysis (see Table 1). 

PARTICIPANTS 

Participant selection is a critical issue, 
which affects study design. First, the sample 
size should be sufficiently large (approxi- 
mately >100). This allows to control for 
possible confounders and to prevent the 
sample from becoming too small during 
follow-up. However, this is often not easy 
to achieve, given the difficulty to recruit 
patients with similar clinical characteristics 
(e.g., dementia subtype, pharmacological 
treatment and doses, disease duration and 
severity, and caregiver support). Current 
reports usually consider really modest sam- 
ples (Niu et al, 2010; Droes et al., 2011; 
Viola etal.,2011). 

Different approaches should be consid- 
ered for small and large groups. In small 
groups, intervention should be focused and 
specific (e.g., restricted to one cognitive 
domain) and based on relevant pre/post 
measures. For their own part, larger sam- 
ples allow to track and control for con- 
founding variables. Although a full clini- 
cal characterization is always desirable, the 
impact of these variables can be tracked 
only with large sample sizes. 

Moreover, depending on the demen- 
tia subtype, diagnosis can be probable 
[e.g., behavioral variant of frontotem- 
poral dementia (bvFTD)] or confirmed 
(e.g., Huntington's disease with confirmed 



mutation). For probable diagnosis, more 
clinical/neuropsychological control mea- 
sures should be considered. Moreover, 
intervention effects can be subtle and dif- 
ficult to identify in conditions with rapid 
progression. Thus, different control and 
intervention strategies should be applied 
depending on diagnosis and sample size. 

METHODOLOGICAL DESIGN 

Intervention design is another critical 
aspect. The assessment should be done by 
specialists, with specific training on the 
intervention program, and the evaluation 
process should be monitored. 

Regarding duration, the intervention 
should be as intense as possible (e.g., 
daily and with a repeated design) to pro- 
duce stronger effects relative to the pre- 
intervention baseline (Kanaan et al., 2014). 
In addition, the intervention should be 
long enough to produce changes in the 
assessed cognitive domains, but total dura- 
tion should be reduced for small groups, 
which have not been controlled for indi- 
vidual differences). The longer the inter- 
vention, the higher the probability that 
uncontrolled individual/personal events 
will affect the results (Luttenberger et al, 
2012). 

Another important factor is specificity 
versus generality. Interventions focused on 
general aspects (quality of life and general 
cognitive status) are more methodologi- 
cally demanding, because of the complex- 
ities of general skill training and measure- 
ment (Carrion et al., 2013). Such situations 
call for a more controlled, multi-measured, 
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Table 1 | Relevant factors for improving research quality of cognitive interventions. 



Participants 


Larger sample sizes allow for better control of confounding variables 




The control and the intervention groups must be matched for critical clinical variables (dementia diagnosis, disease severity, 




pharmacological treatment, caregiver support, etc.) 


Methodologica 


The assessment should be performed by specialists with specific training on the intervention 


design 


The intervention should be as intense as possible and total duration should be long enough to produce changes in the assessed 




cognitive domains 




When interventions are focused on general aspects, a more controlled, multi-measured, and multivariate design with a large sample 




size should be considered 




Application manuals and standardized protocols are required in order to maximize training suitability and protocol comparability 


Control group 


Both groups must be comparable regarding critical clinical variables that can affect cognition 


and intervention 


Both groups should perform an activity that resembles the intervention in terms of intensity, duration, and social-physical 




environments 




Other confounding factors must be controlled for, such as adherence, incidental effects of external/personal events, and differences 




in domains other than the content of intervention 


Pre- and post- 


Different evaluators should be considered to assess pre/post measures as well as cognitive intervention 


measurements 


Measures targeting the specific cognitive domain trained should be used alongside more general measures 




Both self-reports from patients and caregivers and objective measures (ranging from neuropsychology and experimental design to 




brain function techniques, such as fMRI or EEG) must be considered 


Statistics 


Statistical size effects are crucial in pre/post design 


concerns 


Multiple comparisons, multivariate designs, and corrections for multiple comparisons should be performed only with larger samples 




For small samples, statistical assessment should be done at group-comparison level, with a focus on a single independent variable 




indexing the intervention assessment 




For small samples with a control group and pre/post assessment, analysis of multiple single cases should be a subsidiary strategy 



and multivariate design (involving larger 
samples). Training in specific domains 
(e.g., working memory and emotional 
recognition) can be simpler for several rea- 
sons. There are relatively specific domains 
differentially affected in certain dementia 
subtypes [e.g., social cognition in bvFTD 
(Ibanez and Manes, 2012); memory in 
Alzheimer's disease (Parra et al, 2009)]. 
In these cases, targeted interventions may 
allow for more direct and intense train- 
ing. Moreover, participant monitoring is 
more straightforward, pre/post measures 
can be directly related with the con- 
tent of the intervention, and these effects 
can be more easily tracked with specific 
instruments. 

Thus, intervention should be assessed 
by trained and controlled professionals, 
capable of assessing the trade-off between 
intensity, duration, and specificity versus 
generality in program design. A related 
problem is the heterogeneity of the inter- 
ventions and their poor descriptions. 
Application manuals/handbooks and stan- 
dardized protocols are required to maxi- 
mize training efficiency and comparabil- 
ity of protocols (Hunsley and Rumstein- 
McKean, 1999; Town et al, 2012). 



CONTROL GROUP AND CONTROL 
VARIABLES 

The inclusion of a control group and 
control conditions increases the reliabil- 
ity and validity of the results. Repeated 
assessment and random aspects of per- 
sonal experience have an impact on sev- 
eral cognitive domains. Thus, differences 
between pre- and post-measurements are 
not informative on their own. A con- 
trol group should always be consid- 
ered and, if possible, subjects must 
be randomly assigned to the experi- 
mental and control groups. The mock 
intervention or "placebo" effect usually 
emerges in studies involving unspecific 
social/recreational activities or no treat- 
ment at all (Bahar-Fuchs et al., 2013b). 
Control conditions should be carefully 
designed in order to hone specific inter- 
vention strategies. 

Control group design should observe 
the following requisites: (a) patient charac- 
teristics should be measurable and compa- 
rable among groups; (b) the activities per- 
formed should be comparable with inter- 
vention tasks regarding intensity, duration, 
and social-physical environments; and (c) 
confounding factors should be controlled. 



Regarding the latter consideration, a gold 
standard approach should monitor groups 
regarding adherence, incidental effects of 
external/personal events, and differences in 
domains other than the one being assessed. 
The patients and relatives' self-report scales 
and checklists prove very helpful for this 
strategy. If sample size allows, relevant 
individual differences should be measured 
and controlled by means of statistical 
comparisons. The patients' progression 
history, recent significant life events, and 
everyday behavior (diet, exercise, social, 
and recreational activities) should be con- 
trolled by means of group comparisons or 
multivariate analyses. 

Therefore, the detection of 
intervention-specific effects requires a 
strict strategy including a truly comparable 
control group, a monitoring process, and, 
when possible, the control and weighing of 
confounding variables. 

PRE/POST MEASURES 

The difference between pre- and post- 
intervention measures is perhaps the most 
important aspect to consider. A pre- 
intervention measure (or baseline) allows 
controlling for individual differences, and 
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the effect of pre-post repetition can be 
disentangled by including a control group 
(Papp et al., 2009). Nevertheless, the most 
important issue is how to quantify the 
specific domain being trained. 

One important factor is to favor the 
similarity between the measurements and 
the cognitive domain being tested. This 
is easier to address when a specific 
domain is being trained (e.g., working 
memory) because the similarity between 
the training and its measurement is 
restricted to an isolated aspect, and can be 
done by direct measurement of the task 
performance. Nevertheless, when general 
domains are considered (e.g., social func- 
tioning), the distance between the inter- 
vention and an isolated measure becomes 
evident (Owen et al., 2010), requiring com- 
plex or multiple measures (e.g., clinical 
variables, cognitive screening, life qual- 
ity assessment, functionality measures, 
and relatives' reports). A more ambitious 
design should include specific and gen- 
eral training as well as specific and gen- 
eral pre/post-measurements. Note that a 
design as such requires a larger sample 
size, which is rarely observed in current 
reports. 

Another important sub-aspect is the 
degree of objective measurement. Self- 
reports are adequate to assess patients' 
and relatives' subjective experiences of 
changes, but they lack objectivity and 
can be biased by different factors. Sub- 
jective reports should be accompanied 
by objective (implicit and explicit) mea- 
sures, ranging from experimental designs 
to brain measures. Basic general cogni- 
tive assessments (e.g., MMSE and fluid 
intelligence) are usually considered in 
intervention programs, but their gener- 
ality renders them insensitive to subtle 
changes. 

Recent advances in translational cog- 
nitive neuroscience are promissory. Neu- 
roimaging methods have demonstrated the 
sensitivity to training effects, suggesting 
their potential role as systematic measures 
of intervention success (Belleville et al., 
2011). Electromagnetic techniques offer a 
simple, inexpensive approach to tap train- 
ing effects (Vecchio et al., 2013; Yener 
and Basar, 2013). Moreover, recent break- 
throughs in engineering have given rise 
to training-sensitive mathematical applica- 
tions, such as the case of brain connectivity 



measures (with both neuroimaging and 
electromagnetic techniques) (Pievani et al., 
2011). 

In brief, an adequate integrated 
approach to assess cognitive interven- 
tion effects requires the use of multi-level 
measures (self-reports, neuropsychology, 
and neuroscience) and a balance between 
specificity and generality. 

STATISTICAL ISSUES 

Finally, statistical soundness is crucial 
to attain reliability, validity, and replic- 
ability. Although sample size and the 
assessment of confounding variables drive 
most of the considerations, there are 
important decisions, which can bias the 
results. First of all, statistical size effects 
are more imperative in pre/post design 
than in basic research. Thus, they should 
be always reported, because they offer 
direct information about the power of the 
intervention. 

Multiple comparisons and multivari- 
ate designs should be considered only 
with larger samples; otherwise, the sta- 
tistical validity of the results will prove 
highly questionable. Corrections for multi- 
ple comparisons and selection of complex 
statistical designs (e.g., structural equation 
models, discriminant analysis, or support 
vector machine) should also be restricted to 
larger samples. Multi-site studies represent 
a current solution to sample size problems. 

For small samples, statistical assessment 
should be done at group-comparison level. 
The focus should be on a single inde- 
pendent variable indexing the interven- 
tion assessment. A valid alternative in the 
context of small samples with a control 
group and pre/post assessment would be 
the analysis of multiple single cases (Mcin- 
tosh and Brooks, 2011; Sajjadi et al, 2013), 
allowing a deeper examination of interven- 
tion effects. 

CONCLUSION 

Much more knowledge is required to 
understand the dramatic brain changes 
triggered by dementia and the parallel 
effects of training during cognitive inter- 
vention. The assessment of patients with 
dementia tends to underestimate several 
methodological considerations, sometimes 
yielding inconsistent, unreliable, or weak 
results. Here, we have highlighted impor- 
tant decisions, which may impact positively 



on research quality (see Table 1 for a sum- 
mary of these issues). An enhanced con- 
trol and systematization of these issues 
will improve our understanding of how 
cognitive training affects the patients' and 
relatives' quality of life. 
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